1 I 
I 1 



EXPRESS MAIL NO. EL646070392US 




1 




MULTI-SAMPLE METHOD AND SYSTEM FOR RENDERING ANTIALIASED 

IMAGES 

TECHNICAL FIELD 

The present invention is related generally to the field of sampled imagery, 
5 and more particularly, to systems and methods for generating antialiased, sampled images. 



BACKGROUND OF THE INVENTION 

In computer graphics, a sampled image is created from input geometry, 
mathematical computations, and/or the like, typically representing a scene. A sampled 
image is one represented by an array of discrete units, referred to as pixels. The pixels are 

10 generally arranged along two perpendicular axes corresponding to the horizontal and 
vertical axes of the image. The color or monochrome values of the pixels are determined 
by calculated sample values, typically derived from scene data, lighting data, and/or other 
input data. The image represented by the array of pixels is typically transferred to a visual 
medium, such as by being printed onto paper or film or displayed upon a computer display 

15 monitor. The number of pixels and number of colors or values used in rendering a graphics 
image limit, to some extent, the visual qualities and characteristics of the viewed image, for 
example, the image definition, smoothness, and detail. A great amount of effort has been 
devoted to developing sophisticated graphics processing and rendering methods for higher 
image quality. 

20 In addition to high-quality static images, high-quality animation, depicting 

visual effects of motion, is also desirable. The illusion of motion is created by quickly 
displaying related images. In a sequence of image frames in which an object appears in 
different positions, the object may appear to move. Although the motion of the object may 
appear to be continuous, each frame of the animation is a separate image that is displayed 

25 momentarily. Thus, the quality of each frame will affect the quality of the animation or 
illusion of motion. However, depending upon the rendering algorithm, representing motion 
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may result in the creation of motion artifacts. The more noticeable effects include 
"crawling" and "popping" of pixels on a moving edge, for example, an edge of a moving 
object having a value that contrasts against a different value background. 

For example, consider an object, of a first color and having a straight edge, 
5 that appears to be moving across a background of a second color. As the edge of the object 
moves across a pixel, there must be a determination as to when the color of the pixel 
changes from the color of the background to the color of the object. If a single sample 
point within the pixel is taken to determine its color, then, when the edge of the object 
passes this single, sampling location, the color of the pixel is changed. The location of a 

10 single sample point is typically the center of the pixel, and consequently, the value of the 
pixel is determined by the value calculated for the center of the pixel. As a result of a 
single sample point determination for the value of a pixel in a sampled image, the edge of 
an object may extend well into the region represented by the pixel, but the pixel may have 
the value of the background, because the edge has not reached the sampling point at the 

1 5 center of the pixel. 

When multiple images, or frames, are displayed in sequence, to provide the 

4 

illusion of objects in motion, pixels along the edge of an object may "pop" from one color 
or value to another. This effect can be distracting for a viewer. The relative motion of an 
object with respect to the orientation of the pixels of the image may be such that pixels 

20 along the edge of the object pop values in a manner and with a regularity that creates a 
visual effect of the edge of the object "crawling." 

There have been many different approaches to addressing the issue of 
aliasing. Aliasing includes such static edge-effects as "staircasing" and such motion 
artifacts as "pixel popping" and crawling. One such approach is to increase the resolution, 

25 or the number of pixels used to represent an image. The available resolution of computer 
graphics displays has increased dramatically, reducing, but not eliminating, aliasing. 
Similarly, printing devices have been increasing resolution, as well. However, there are 
practical limitations on the manufacturing of displays and other devices used for forming or 
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recording an image. In addition, there are practical limitations with respect to the 
computation components which can be devoted to rendering an image. Processing more 
samples, at the centers of more pixels, takes longer, on a given device. Moreover, no 
matter how high a (finite) resolution is used to represent a graphics image, so long as the 
5 value of each pixel is only approximated from calculated values for discrete, sample points, 
the image is subject to some degree of aliasing, and a sequence of such images is subject to 
motion artifacts. 

However, aliasing can be "anti-aliased" to some degree, by taking advantage 
of the number of values available for each pixel. More specifically, multi-sampling 

10 systems for anti-aliased rendering use sample values from multiple samples taken from a 
pixel region in determining the value of the respective pixel. When multi-sampling is 
applied to our example, above, as the edge of the object passes the first sample point 
encountered, the pixel is given a value that is a compromise between the value of the object 
and the disparate value of the background. Let's assume that the size, shape and motion of 

15 the object result in the object gradually and completely covering the pixel, one sampling 
point at a time. The value given to the pixel changes, each time the object covers another 
sample point of the pixel, until all of the sample points share the color of the object, at 
which time the pixel takes on the color of the object. The value of the pixel more 
accurately represents the proportion of the pixel occupied by the object at any moment, and 

20 over time. 

The multiple samples for each pixel are typically arranged, within a region 
associated with the pixel, in an ordered pattern, such as in a rectangular grid, or in a 
pseudo-random fashion. We will refer to any arrangement of samples with respect to a 
pixel as a "sampling pattern", or "sample pattern". Regions associated with neighboring 
25 pixels may overlap. Pseudo-random multi-sampling per pixel generally requires a large 
number of samples per pixel, and considerable computation. Some anti-aliasing methods 
employ sampling patterns designed to simulate random sampling, and they, too, typically 
compute a large number of samples. 
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Although conventional multi-sample anti-aliasing methods generally can 
reduce motion artifacts and edge effects, aliasing remains. For example, a solid square, 
with edges parallel to the axes of the image, moving vertically, may create a popping effect 
by encountering multiple sample points within a pixel, simultaneously, if the sample points 
5 are arranged in a rectangular grid, within the pixel. Taking more samples per pixel may 
reduce the severity of motion artifacts, but processing overhead and economic 
considerations will place practical limits on the maximum number of samples that can be 
reasonably taken per pixel. 

Therefore, there is a need for an alternative system and method for rendering 
!=i 10 an image, while reducing aliasing, such as motion artifacts and edge effects. 

yl 

fl j SUMMARY OF THE INVENTION 
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~fJj The present invention relates to a method and system for performing multi- 
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fi sample, anti-aliased rendering of images. The value of a pixel of an image is computed 

s from one or more sample values, each computed at a respective sample point, position, or 

hj 15 location, the sampling points, positions, or locations for a pixel being arranged in a 
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«f sampling pattern. We will refer to "sampling point," "sample point," "sampling location," 

□ "sample location," "sampling position," or "sample position" interchangeably. Different 

•* * 

sampling patterns may apply to different pixels. An alternate sampling pattern may be 
applied to alternate pixels along lines parallel to a first axis and/or along lines parallel to a 

20 perpendicular second axis. A repeating sequence of sampling patterns may be applied to 
consecutive pixels along a row or column. Also, a sampling pattern may have four sample 
locations within the region of a pixel. The four samples are arranged within the pixel 
region such that were the pixel region divided into a four-by-four array of sub-regions, the 
four sample locations would be arranged within the pixel region in a manner such that no 

25 two samples are located in the same row, column, or diagonal of sub-regions. A sampling 
pattern may use only two or three of these four potential positions. A sampling pattern may 
be applied repeatedly to a pixel. Sample values taken for a pixel may be combined and 



cumulated with previously calculated and stored values. Within a frame the same sampling 
pattern and the same sampling locations may be used each time a pixel is sampled in order 
to avoid introducing artifacts. Sample values for a pixel are combined to calculate a value 
for the pixel. 



BRIEF DESCRIPTION OF THE DRAWINGS 

Figure 1 is a block diagram of a system in which embodiments of the 
present invention are implemented. 

Figure 2 is a block diagram of a graphics processing system in the system of 

Figure 1 . 

Figure 3 is a diagram of a multi-sample pattern according to an embodiment 
of the present invention. 

Figure 4 is a diagram of a multi-sample pattern according to another 
embodiment of the present invention. 

Figures 5a and 5b are a diagram of a multi-sample pattern according to 
another embodiment of the present invention. 

Figure 6 is a diagram of a multi-sample pattern according to another 
embodiment of the present invention. 

Figure 7 is a diagram of a multi-sample pattern according to another 
embodiment of the present invention. 

Figure 8 is a diagram of a multi-sample pattern according to another 
embodiment of the present invention. 

Figure 9 is a diagram of a multi-sample pattern according to another 
embodiment of the present invention. 



DETAILED DESCRIPTION OF THE INVENTION 

Embodiments of the present invention render anti-aliased images by 
reducing artifacts in bothVtatic images and also in motion pictures or animation. The 
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systems and methods described herein perform anti-aliased rendering through a process of 
taking multiple samples, or "over-sampling," for calculating values of pixels such ascolor 
or depth values in forming a resulting computer graphics image. Certain details are set 
forth below to provide a sufficient understanding of the invention. However, it will be 
5 clear to one skilled in the art that thk invention may be practiced without these particular 
details. In other instances, well-knowi circuits, control signals, timing protocols, and 
software operations have not been shown in detail in order to avoid unnecessarily obscuring 
the invention. \ 

Figure 1 illustrates a computer system 100 in which embodiments of the 

10 present invention are implemented. The computer system 100 includes a processor 104 
coupled to a memory 108 through a memory/bus interface 112. The memory/bus interface 
1 12 is coupled to an expansion bus 116, such as an industry standard architecture (ISA) bus 
or a peripheral component interconnect (PCI) bus. The computer system 100 also includes 
one or more input devices 120, such as a keypad or a mouse, coupled to the processor 104 

15 through the expansion bus 1 16 and the memory/bus interface 112. The input devices 120 
allow an operator or an electronic device to input data to the computer system 100. One or 
more output devices 1 24 are coupled to the processor 1 04 to receive output data generated 
by the processor 104. The output devices 124 are coupled to the processor 104 through the 
expansion bus 1 16 and memory /bus interface 1 12. Examples of output devices 124 include 

20 printers and a sound card driving audio speakers. One or more data storage devices 128 are 
coupled to the processor 1 04 through the memory /bus interface ,112 and the expansion bus 
1 16 to store data in, or retrieve data from, storage media (not shown). Examples of storage 
devices 128 and storage media include fixed disk drives, floppy disk drives, tape cassettes 
and compact-disc read-only memory drives. 

25 The computer system 100 further includes a graphics processing system 132 

coupled to the processor 104 through the expansion bus 1 16 and memory /bus interface 112. 
Optionally, the graphics processing system 132 may be coupled to the processor 104 and 
the memory 108 through other types of architectures. For example, the graphics processing 
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system 132 may be coupled through the memory /bus interface 112 and a high speed bus 
136, such as an accelerated graphics port (AGP), to provide the graphics processing system 
132 with direct memory access (DMA) to the memory 108. That is, the high speed bus 136 
and memory bus interface 112 allow the graphics processing system 132 to read and write 
5 memory 108 without the intervention of the processor 104. Thus, data may be transferred 
to, and from, the memory 108 at transfer rates much greater than over the expansion bus 
116. A display 140 is coupled to the graphics processing system 132 to display graphics 
images. The display 140 may be any type of display, such as those commonly used for 
desktop computers, portable computers, and workstations, for example, a cathode ray tube 

10 (CRT), a field emission display (FED), a liquid crystal display (LCD), or the like. 

Figure 2 illustrates circuitry included within the graphics processing system 
132 for performing various graphics and video functions. As shown in Figure 2, a bus 
interface 200 couples the graphics processing system 132 to the expansion bus 116 and 
optionally high-speed bus 136. In the case where the graphics processing system 132 is 

15 coupled to the processor 104 and the memory 108 through the high speed data bus 136 and 
the memory /bus interface 112, the bus interface 200 will include a DMA controller (not 
shown) to coordinate transfer of data to and from the host memory 1 08 and the processor 
104. A graphics processor 204 is coupled to the bus interface 200 and is designed to 
perform various graphics and video processing functions, such as, but not limited to, 

20 generating vertex data and performing vertex transformations for polygon graphics 
primitives that are used to model 3D objects. The graphics processor 204 is coupled to a 
triangle engine 208 that includes circuitry for performing various graphics functions, such 
as clipping, attribute transformations, rendering of graphics primitives, and generating 
texture coordinates for a texture map. The triangle engine further includes anti-aliasing 

25 circuitry 214 according to embodiments of the present invention. As will be described in 
more detail below, embodiments of the anti-aliasing circuitry 214 over-sample within the 
pixels of the graphics image to reduce aliasing artifacts. 
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A pixel engine 2 1 2 is coupled to receive the graphics data generated by the 
triangle engine 208. The pixel engine 212 contains circuitry for performing various 
graphics functions, such as, but not limited to, texture application or mapping, bilinear 
filtering, fog, blending, and color space conversion. A memory controller 216 coupled to 
5 the pixel engine 212 and the graphics processor 204 handles memory requests to and from a 
local memory 220. The local memory 220 stores graphics data, such as pixel values. A 
display controller 224 is coupled to the memory controller 216 to receive processed values 
for pixels that are to be displayed. The output values from the display controller 224 are 
subsequently provided to a display driver 232 that includes circuitry to provide digital 

10 signals, or convert digital signals to analog signals, to drive the display 140 (Figure 1). It 
will be appreciated that the circuitry included in the graphics processing system 132 to 
practice embodiments of the present invention may be of conventional designs well 
understood by those of ordinary skill in the art. 

Although the anti-aliasing circuitry 214 is illustrated in Figure 2 as being 

15 included within the triangle engine 208, it will be appreciated that the anti-aliasing circuitry 
214 which may include various memory units, for example to store sampling patterns, may 
also be a circuit separate from the triangle engine 208, and/or included in one of the 
aforementioned circuit blocks of the graphics processing system 132, such as the pixel 
engine 212. Moreover, the anti-aliasing circuitry 214 may be spread between various 

20 circuit blocks of the graphics processing system 132. For example, steps of the anti-aliased 
rendering operation may be shared between the triangle engine 208 and the pixel engine 
212. That is, when geometric primitives are rendered by the triangle engine 208, sample 
values are calculated for each sample point, typically of each pixel having a portion covered 
by the geometric primitive. Once the over-sampling is performed, the pixels may be further 

25 processed, for example, for depth, texture, and the like, and then the pixel engine 212 may 
perform the down-sampling or combining of the multiple sample values. Therefore, the 
particular location of the anti-aliasing circuitry 214 is a detail that may be modified without 
deviating from the subject matter of the invention, and should not be used in limiting the 
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scope of the present invention. The description provided is sufficient to enable those of 
ordinary skill in the art to practice the invention, and consequently, in the interest of 
brevity, a more detailed description of the particular circuitry of the anti-aliasing circuitry 
214 has been omitted from herein. 
5 As previously mentioned briefly, the anti-aliasing circuitry 214 facilitates 

anti-aliasing by over-sampling for at least some pixels of a graphics image. The sample 
values for the multiple samples for a pixel are calculated for each triangle or other primitive 
covering, or partially covering, the pixel. The sample value for a given sample position 
within a given pixel may be stored and/or altered, for example by well-known z-buffer 

10 techniques, in accordance with the processing of other data, such as other primitives 
touching the same sample position in the same pixel. Later, the final sample values for a 
given pixel are then combined, in the pixel engine or texture engine (not shown) .or blend 
unit (not shown), to determine a sample value for the pixel in the resulting image. Anti- 
aliased rendering by taking multiple samples is known in the art. However, as described in 

15 the Background of the Invention, conventional methods of anti-aliased rendering 
nevertheless still suffer, for example, from motion artifacts related to moving objects 
having edges aligned with the axes of the pixel coordinate system. Embodiments of the 
present invention use a more sophisticated over-sampling method than in conventional anti- 
aliasing rendering methods. Simply increasing the number of sampling points per pixel 

20 would suffer from the shortcomings previously described. Instead, the number and 
positions of samples taken for a pixel, according to each particular sampling pattern to be 
used, as well as the selection of the particular pattern of samples to be applied to a given 
pixel, are arranged to improve processing efficiency and/or perceived visual quality. 

It will be appreciated that the sample values may represent values such as 

25 color values or grayscale values and/or depth values, etc., at a sample location. It will be 
further appreciated that the sample values for the samples may consist of several different 
components. For example, a sample value may represent not only a pixel color, as a 
combination of red, green, and blue color components, but also a depth value. Another 
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example includes sample values representing pixel colors which are combinations of luma 
and chroma components. Consequently, because it is well understood in the art, although 
circuitry to perform graphics operation for each of the components is not expressly shown 
or described herein, embodiments of the present invention include circuitry, control signals, 
5 and the like necessary to perform operations on each component for multi-component 
sample values. 

Illustrated in Figure 3 is a sampling pattern according to an embodiment of 
the present invention that may be used by the anti-aliasing circuitry 214 (Figure 2). The 
sampling pattern is referred to herein as the "alternating 2 Queens" pattern. The pixels 
ri 1 0 shown in Figure 3 are arranged in rows and columns, and define a pixel region from which 

• if "a 

samples are taken. The sampling pattern defines the sampling locations within a pixel 
tlJ region at which sample values are calculated. The sample locations are relative to a pixel, 

jl In the alternating 2 Queens sampling pattern, two samples are taken per pixel region, or per 

** m 
~ t 

• ■» 

^ pixel. The two samples, from one pixel to the next, alternate between being arranged off- 

^ 15 vertical and off-horizontal, such that every other pixel has the same arrangement of two 

2 5 

Ld sampling points. As with the conventional anti-aliasing methods, the resulting value for a 

7 . a 

- j* 

pixel is derived from a contribution from each sample value. By over-sampling the pixels 
^ using the sample locations illustrated in Figure 3, motion can appear smoother than when 

not using oversampling, yet only two samples are taken, per pixel. Pixel-popping is 

20 reduced, since a pixel can attain an intermediate value as the object engulfs one sample 
position at a time. When an object having an edge parallel to an axis of the pixel 
coordinate system is in motion across a display, two sample positions parallel to the 
moving edge would be all in, or all out, simultaneously. Thus, the pixel value would, at 
once, pop from background value to object value, with no intermediate value, such as 

25 would be attained when using the positions defined by the alternating 2 Queens pattern. 
Arguably, objects in motion and having edges in alignment with the samples within the 
pixels will still suffer from motion artifacts. However, vertical and horizontal edges are 
very common and numerous in scenes, and thus, more problematic, when they 



11 



predominate. Thus, the alternating 2 Queens pattern reduces aliasing caused by the more 
numerous types of edges typically encountered. Also, with the alternating 2 Queens 
method, aliasing introduced by a line lying at the same angle as the samples in a given pixel 
will not tend to extend to the next pixel, as that pixel's samples lie at a different angle. 
5 Consequently, although the over-sampling pattern previously described does not eliminate 
motion artifacts completely, anti-aliasing methods using this sampling method can produce 
images having a more natural visual appearance. 

Figure 4 illustrates a sampling pattern referred to as "2 Queens." The 
sampling pattern is similar to the alternating 2 Queens pattern shown in Figure 3, however, 

10 rather than alternating the sampling pattern every pixel, the sampling pattern remains the 
same for each of the pixels. As shown in Figure 4, the two sample locations are arranged 
substantially along the vertical direction. However, it will be appreciated that the 2 Queens 
pattern of Figure 4 can be itself modified by having the sample positions substantially 
arranged along a horizontal axis. 

15 Figures 5a and 5b illustrate sampling patterns resulting from modifications 

of the alternating 2 Queens pattern shown in Figure 3. As discussed with respect to Figure 
3, in the alternating 2 Queens pattern every second pixel has the same arrangement of two 
sampling points. In Figures 5 a and 5b, this aspect of the alternating 2 Queens is modified 
' such that the arrangements of the samples in every second pixel are mirror images. That is, 

20 the sampling patterns for every fourth pixel are the same. The resulting sampling pattern 
will be referred to herein as a "mirrored alternating 2 Queens" sampling pattern. 

The sampling patterns illustrated in Figures 5a and 5b are only two of many 
different arrangements that may be made in accordance with the rules of the mirrored 
alternating 2 Queens sampling pattern. For example, as illustrated in Figure 5a, if the 

25 region defined by a pixel is divided into a four-by-four array of sub-elements, the sampling 
positions of pixel 704a are located at (3, 1) and (0, 2), and the sampling positions of pixel 
708a, (0, 1) and (3, 2). That is, pixel 708a has sampling positions that are arranged as the 
mirror image of pixel 704a. In comparison, in Figure 5b, the sampling positions of pixel 
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704b are located at (0, 1) and (3, 2) and pixel 708b has sampling positions located at (0, 2) 
and (3, 1). Thus, although the sampling positions of 704 and 708 are mirror images of the 
other in both Figures 5a and 5b 5 according to the rule for the alternating 2 Queens pattern, 
the sampling patterns of the two figures are different. Similarly, another modification that 
5 can be made is the positional relationship of the two samples of pixel 712 and pixel 704. 
That is, in Figure 5a, the two samples of pixel 712a are arranged in the same fashion as for 
pixel 704a, but in Figure 5b, the samples of pixel 712b are a mirror image of 704b. 
Additionally, it will be appreciated that the rule of mirror image sampling for every other 
pixel can be applied not only for pixels along both axes of the image, as shown in Figures 

10 5a and 5b, but may be applied either only along the rows, or only along the columns, of 
pixels of an image. Thus, modifications such as these may be made to change the overall 
sampling pattern but still fall within the scope of the present invention. 

The sampling patterns illustrated in Figures 4 and 5 effectively reduce 
aliasing in graphics images; however, a side-effect of the anti-aliasing operation is the 

15 introduction of noise into the images. In the embodiment illustrated in Figure 6, a mirrored 
alternating 2 Queens pattern is used for sampling. However, the distance between the two 
samples of a pixel have been reduced in comparison to the alternating 2 Queens patterns 
shown in Figures 4 and 5. Reducing the distance between the two samples of a pixel 
changes the balance between noise and anti-aliasing. That is, as the samples are located 

20 more toward the center of a pixel, the noise resulting from the anti-aliasing operation is 
reduced, but at the expense of also reducing the amount of anti-aliasing. Varying the 
distance of the sample locations within a pixel is a mechanism by which the relationship 
between the noise created by the anti-aliasing operation and the amount of anti-aliasing 
applied to an image can be adjusted. The angles used may vary, as well. 

25 Figure 7 illustrates another sampling pattern that may be used in performing 

an anti-aliasing operation in accordance with an embodiment of the present invention. 
Similar to the alternating 2 Queens patterns previously discussed, the "multi-rate" sampling 
pattern employs some aspects of the 2 Queens patterns, but alternates the number of 
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samples per pixel in an ordered fashion. As shown in Figure 7, the second row of pixels 
are sampled only once, in the center, while an alternating 2 Queens pattern is applied to 
every other row of pixels. As shown in Figure 7, the effective sampling rate is 
approximately equal to the average of the two sampling patterns, that is, approximately 
5 equal to a 1.5X sampling rate. It will be appreciated, however, that the frequency at which 
the sampling pattern changes may be modified without deviating from the scope of the 
present invention. For example, the sampling pattern may change every three rows (instead 
of every two, as shown in Figure 7). Alternatively, the multi-rate sampling pattern may 
change per pixel. The changes in sampling pattern may occur along either axis of the 
10 image. 

Illustrated in Figure 8 is a sampling pattern according to another 
embodiment of the present invention that may also be used by the anti-aliasing circuitry 
214 (Figure 2). In contrast to the alternating 2 Queens patterns previously discussed, the 
anti-aliasing circuitry 214 uses four samples for each pixel. The locations of the four 

15 samples are described as follows. Each pixel region is conceptually divided into 16 sub- 
regions arranged in a four-by-four array of sub-regions as first illustrated in Figures 5a and 
5b. The four sample points are arranged within the pixel region as shown in Figure 8. 
Specifically, the samples are located at sub-element coordinates (2,0), (0, 1), (3, 2), and 
(1,3). The sample pattern illustrated in Figure 8 is referred to as "4 Queens", in reference to 

20 the game of chess. The pattern results from placing four queens at locations in the four-by- 
four matrix such that no queen is attacking another. That is, the region of a pixel is divided 
into a four-by-four array of sub-regions, and the four sample locations are arranged within 
the pixel region in a manner where no two samples are located along the same row, 
column, or diagonal of sub-regions. 

25 The 4 Queens pattern is repeated for each pixel of the graphics image. 

Although the 4 Queens sampling pattern uses twice as many samples as the alternating 2 
Queens sampling patterns previously discussed, and consequently, will require more 
processing, partial coverage of a pixel is more faithfully depicted, because the value 
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computed for a pixel is based on the contribution of sample values from two additional 
samples. Thus, sub-pixel-stepped motion through a pixel, and/or objects half the width of a 
pixel, are more accurately portrayed. 

The sampling pattern described with respect to Figure 8 can be modified in 
order to reduce the collinearity of samples along certain angles to the horizontal and 
vertical axes. Figure 9 illustrates a possible modification. The 4 Queens sampling pattern 
of Figure 8 is modified by using a second 4 Queens sampling pattern every other pixel 
(Notice that the second sampling pattern also satisfies the 4 Queens criteria described with 
respect to Figure 8.) This "alternating 4 Queens" rule is enforced along the rows and 
columns of the pixels such that the sampling patterns of row- and column-adjacent pixels 
are mirror images of one another. As a result, such adjacent pixels are sensitive to edges 
lying at different angles, and this addresses to some degree, artifact issues related to the 4 
Queens sampling pattern of Figure 8. 

The 4 Queens and alternating 4 Queens sampling patterns illustrated in 
Figures 8 and 9, respectively, use four sample points per pixel. However, where processing 
capabilities of the anti-aliasing circuitry 214 or the graphics processing system 132 
(Figure 2) are limited, having four samples per pixel may reduce overall system 
performance. Thus, a compromise in image quality in return for using fewer samples per 
pixel, such as with the alternating 2 Queens patterns previously discussed with respect to 
Figures 4 and 5, may be an acceptable alternative. On the other hand, where greater 
processing capabilities are available, or where the number of samples taken for each pixel 
is inconsequential, alternative alternating sampling patterns can be implemented without 
deviating from the scope of the present invention. That is, although alternating sample 
patterns have been previously shown in and described with respect to the sampling patterns 
of Figures 3 and 9, other alternating sample patterns having any plurality of sample 
locations can also be used in embodiments of the present invention. 

It will be appreciated that many of the previously described methods can be 
more generally described as using more than one sampling pattern to calculate values for 
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pixels of an image. For example, the alternating 2 Queens and alternating 4 Queens 
methods both have at least two different sampling patterns that are used in calculating 
values for a pixel. It will be further appreciated that many other techniques using multiple 
sampling patterns can be developed as well. Additionally, it should be noted that to avoid a 
5 "boiling" effect, the same pattern is typically used in the same pixel position in successive 
frames. A "cut" to a different scene is a general exception to this rule of thumb. However, 
in most cases, the pattern applied should be the same for the same pixel, in subsequent 
frames, whatever the embodiment of the invention. It will be appreciated, however, that 
changing the sampling pattern for a pixel in successive frames nevertheless remains within 
10 the scope of the present invention. The following sampling patterns and sampling methods 
are provided by way of example, and are not intended to limit the scope of the present 
invention. 

In one embodiment, the sampling patterns for a first group of pixels (e.g., 
ij pixels 1-4) may repeat, in the same order, for a second group of pixels (e.g., pixels 5-8). 

V 15 The patterns of the first and second groups of pixels are repeated in the same sequence 
along either or both axes. For example, pixels 9-12, pixels 13-16, and so on, have the same 
sequence of sampling patterns as pixels 1-4. Thus, rather than having two sampling 
patterns alternate from pixel to pixel, a group of sampling patterns will repeat periodically 
from one group of pixels to the next. Two alternating patterns comprise a periodically 
20 repeating group, namely a group of 2 patterns. 

In an alternative embodiment, a set of sampling patterns can be defined for 
use, and, on a per-pixel basis, one of the sampling patterns can be selected for use when 
calculating a value for a pixel. The selection process may be predetermined, or, may 
actually occur as calculation of the sample values proceeds. The sampling patterns can 
25 have various numbers of samples and have several arrangements of sample locations. 
Moreover, the method by which a sampling pattern is selected for a pixel can be made by 
various techniques. For example, five different sampling patterns S0-S4 may be 
programmed into memory for the set of sampling patterns. The memory into which the 
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sampling patterns are programmed is a conventional memory device such as a read-only 
memory (ROM), dynamic random access memory (DRAM), or a static random access 
memory (SRAM), or the like. Such a memory may be included in the local memory 220 
(Figure 2) or in one of the other functional blocks shown in Figure 2, for example, the 
5 triangle engine 208, or in a separate unit (not shown). With a ROM, of course, the patterns 
may not be changed during operation. 

When values for a pixel are to be calculated, a selection method is employed 
to determine which of the five sampling patterns will be used for the pixel. In one 
embodiment, the sampling patterns are selected in the same sequence as they are stored in 
10 memory. Each successive pixel, e.g., along a row, is sampled according the pattern stored 
4} in memory following the pattern applied to the predecessor pixel. In another embodiment, 

m the selection of the sampling pattern is made by use of a pseudo-random technique where a 

^ selection algorithm attempts to simulate a random selection of the sampling pattern. In 

&i another embodiment, the selection of a sampling pattern from the set of five is made using 

* 15a random selection. It will be appreciated that there are many well-known techniques for 
Tfi implementing the selection techniques described herein, and, although a more detailed 

»f description of the various techniques has not been provided, those of ordinary skill in the 

■ ii' «*i 
— »j 

Q art have sufficient understanding to practice embodiments of the present invention. 

In an alternative embodiment of the present invention, rather than having 

20 pre-defined sampling patterns from which one is selected when calculating sample values 
for a pixel, a deterministic technique is used to compute the sample locations from which 
values for a pixel are calculated. For example, a pixel region may be thought of as divided 
into sixteen different sub-regions arranged in a four-by-four array as previously mentioned. 
The center of each of the sub-regions represents a location at which a sample can be 

25 calculated. Determination of which of the sixteen potential locations will be sampled can 
be made using a deterministic selection technique. A simple example of such a selection 
technique is to increment through a four-bit value where each binary value represents a 
different sample location of the sixteen available. It will be appreciated that other 



17 



s 



. 5 



deterministic selection techniques can be developed by those of ordinary skill in the art. It 
will be further appreciated that although the selection of a sample location within a pixel 
has been described with respect to a single sample location, a plurality of samples may be 
calculated for a pixel as well, each of the sample locations determined in accordance with a 
5 deterministic selection technique. It will be appreciated that the embodiments previously 
described may be implemented either by the deterministic scheme of this paragraph, or by 
the "patterns-in-memory" regime of the previous paragraph, or by some combination of 
both, or by other means. 

In another embodiment of the present invention, the various sampling 
1 0 patterns described herein may be used in a sampling method where the sampling positions 
3 of a sampling pattern are "jittered" when calculating the sample values for a pixel in the 

1 

j image. That is, a sampling pattern is defined, and, prior to calculating sampling values, its 

sampling positions are altered at the sub-pixel level. In effect, when a pattern is applied to 
a pixel, different pseudo-random or random offsets, varying independently in x and y, are 
15 added to the coordinates of each sample position, before the samples are calculated. 
Conventional methods do such jittering for patterns comprising regular grids of samples. 
(Different offsets may be used for the same pixel, from frame to frame, although generally, 
the same pattern should be used before the offsets are applied.) In this manner, correlation 
of sample locations is diminished, and consequently, the occurrence of artifacts such as 
20 staircasing, pixel popping, and pixel crawling, will be reduced. Typically, the same offsets 
would be used for a given pixel for all sampling within a frame, as above. 

In another embodiment, a linear transformation including a rotation of the 
sampling pattern may also be used for shifting, on a per pixel basis, the sampling locations 
of a sampling pattern. 

25 As previously discussed, a value for a pixel is calculated from the respective 

sample values. Many well known calculation techniques for calculating values for pixels 
from the respective sample values may be used in embodiments of the present invention. 
For example, combinations of sample values can be cumulated from and to stored sample 
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values for finally calculating a value for a pixel from respective stored cumulated sample 
values. For example, this is done in z-buffer methods, where z is depth. 

Selection of which sampling patterns or combinations or sequences of 
patterns to employ may be based on the type of image being represented by the pixel 
5 information. For example, one sampling pattern may be better suited for a particular game 
with animation, whereas another sampling pattern may be better suited for some particular 
still images. One game may include sequences optimized by different patterns, and 
embodiments of the present invention permit re-programming. Patterns may be used in 
various combinations and sequences, even within a frame or single image, as warranted by 
10 the image content. Thus, a system or method may use more than one sampling pattern to 
optimize image quality. 

It will be appreciated that embodiments of the present invention may be 
practiced using conventional software language and conventional hardware circuitry well 
understood by those of ordinary skill in the art. In either case, the description provided 
15 herein is sufficient to allow those of ordinary skill in the art to practice the present 
invention without the need for undue experimentation. Moreover, as previously mentioned, 
certain details have been set forth above to provide a sufficient understanding of the 
Q invention. However, it will be clear to one skilled in the art that the invention may be 

practiced without these particular details. In other instances, well-known circuits, control 
20 signals, timing protocols, and software operations have not been shown in detail in order to 
avoid unnecessarily obscuring the invention. 

Thus, from the foregoing it will be appreciated that, although specific 
embodiments of the invention have been described herein for purposes of illustration, 
various modifications may be made without deviating from the spirit and scope of the 
25 invention. For example, embodiments of the present invention have been described as 
being implemented in a computer system, and more specifically, a graphics processing 
system included in the computer system. However, embodiments of the present invention 
may be implemented in other systems where graphics processing is desirable, such as 
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gaming systems, set-top boxes for cable television, printing devices, and the like. More 
generally, embodiments of the present invention may be implemented in general processing 
environments, where the sampling techniques described herein are carried out by a general 
purpose computer. Additionally, although embodiments of the present invention have been 
described herein for application with 3D computer graphics, it will be appreciated that the 
present invention is also applicable to 2D graphics, where the sample values are calculated 
from scenes or other two-dimensional (2D) representations, and to the visualization of 
higher dimensional mathematics, image processing and so forth. Accordingly, the 
invention is not limited except as by the appended claims. 



